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(57) Abstract 

A video signal is analysed to determine what compression coding decisions would be taken if the video signal were to be MPEG 2 
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VIDEO SIGNAL COMPRESSION! 



The invention relates to video signal compression. 

In an important example, the invention concerns the MPEG-2 video 
signal compression standard, ISO/IEC 13818-2, though it can be applied to 
any video compression system that is liable to degradation when coding and 
decoding are cascaded. 

There has already been disclosed (WO-A-9535628) the use of a signal 
which accompanies an MPEG bitstream and which carries information about 
the bitstream for use in a downstream process, for example, the re-encoding 
of a decoded MPEG picture. This signal is provided in parallel and is sent 
along an appropriate side channel to accompany a decompressed signal from 
a compression decoder to a subsequent encoder. 

Where equipment has been specifically designed for use with such a 
' signal, considerable advantage can be gained and many of the problems 
previously associated with cascaded coding and decoding processes are 
removed or ameliorated by using in a downstream coding process, key 
information concerning upstream coding and decoding. 

In WO-A-9803017, there are disclosed techniques which extend these 
advantages, in part or in whole, to arrangements which include equipment not 
specifically designed for use with such a signal. Specifically, these 
techniques include embedding the information signal in the video signal so 
that it can pass transparently through a video pathway. 

It is an object of this invention to provide improved apparatus and 
processes which offer benefits not just in a cascaded recoding operation but 
in a primary coding operation. 

Such a primary coding operation will usually be applied .to a video 
signal which has not previously been compressed. The possibility is included, 
however, of a "primary" coding operation on a video signal which has been 
compressed but without advantage having been taken of any of the 
techniques disclosed in either of the above referenced documents. 
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Accordingly, the present invention consists, in one aspect, in a video 
signal process comprising the steps of analysing a video signal and taking 
com pression cod ing decisions informing a representation of the coding 
decisions for passage with the video signal along a video pathway and, 
downstream of the video pathway, compression encoding the video signal in 
accordance with said coding decisions. 

In another aspect, the present invention consists in compression pre- 
processing apparatus, comprising means for analysing a video signal and 
taking compression coding decisions; means for processing the coding 
decisions and means for outputting the processed coding decisions for 
passage with the video signal along a video pathway. 

The coding decisions may include the following information: picture 
dimensions; frame rate; picture structure (frame-coded or field-coded); picture 
type (I, P or B): whether macroblocks are intra-coded or use prediction; 
whether forward, backward or bi-directional prediction is used; motion vectors; 
transform type; quantizer visibility weighting matrices; quantizer step; bit rate 
and buffer state of a downstream decoder. 

In this description, the term information bus is used to represent 
information relating to a coding operation, which information accompanies a 
decoded signal, a partially decoded signal or a yet-to-be-coded signal. More 
detail can be found with reference to WO-A-9535628. The information bus is 
preferably embedded within a video signal for example as disclosed in WO-A- 
9803017. The content of both WO-A-9535628 and WO-A-9803017 is herein 
incorporated by reference. 

The invention will now be described by way of example with reference 
to the accompanying drawings, in which:- 

Figure 1 is a block diagram of a compression pre-processor 
according to one embodiment of this invention; 

Figure 2 is a block diagram of a compression pre-processor 
according to a second embodiment of this invention; and 

Figure 3 is a block diagram illustrating three alternative server- 
based processes according to this invention making use of the 
information provided by the pre-processor of Figure 1 or Figure 2. 
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Turning to Figure 1 , an input video signal which has not previously 
_ bee n encoded is presented at input terminal 100 and passes to an MPEG2 

encoder 102. This encoder takes one of the forms disclosed in WO-A- 
5 9535628 and has in addition to the MPEG output, an information bus output 

on which appear a representation of the coding decisions taken in the 
encoder. These coding decisions may include the following information; 
picture dimensions; frame rate; picture structure (frame-coded or field-coded); 
picture type (I, P or B): whether macroblocks are intra-coded or use 
io prediction; whether forward, backward or bi-directional prediction is used; 
motion vectors; transform type; quantizer visibility weighting matrices; 
quantizer step; bit rate and buffer state of a downstream decoder. 

The information bus then joins the input video signal for passage in 
tandem along a video pathway. It should be noted that the video signal at the 
is output has undergone no processing, beyond delay in an appropriate 
compensating delay 104. 

There are a variety of preferred ways in which the information bus can 
accompany the video signal. For example, the information bus can be carried 
in the least significant bit of the colour-difference part of a 10-bit ITU-R Rec. 
20 656 signal, within the active video region only. This provides a raw bit-rate of 
10.368 Mbit's for the information bus. Care will be taken to ensure that the 
presence of this additional information does not cause visible impairments to 
the video signal and that studio equipment quoted as f 10 bits' is indeed 
transparent to all ten bits of the signal when no mixing or other processing is 
25 being performed. In other implementations, the information bus might be 
transported in the 9th or 8th colour-difference bit, in the 10th, 9th or 8th 
luminance bit or in any combination of the above. Use of the 8th bit would 
also be appropriate for systems using earlier versions of the Rec. 656 
standard where only 8-bit representation is available. 
30 Another example is an extension of the above approach, in which any 

part of the digital video signal (not just the least significant bit) is modified by 
adding the information bus data to the video in such a way that a downstream 
MPEG coder would be unaffected. 
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It is also possible to carry the information bus in an ancillary data 
channel carried in the blanking periods of the Rec. 656 signal. It would be 
. -^es^ry to ensure that : studio equipment.passed this information 
unchanged when no mixing or other processing was being performed. 

A still further example is to send the information bus as an AES/EBU 
digital audio channel. This would be passed through a spare channel in the 
audio path of the studio equipment. It would be necessary to ensure that 
switching of that particular audio channel would be performed along with the 
video switching, even though the main audio channel(s) might be switched 
independently of the video. 

Figure 2 shows a more detailed configuration of a compression pre- 
processor according to the present invention. An information bus 
generator 202 receives the input video signal and generates a 'skeleton' 
information bus containing picture. GOP and sequence rate information 
relating to the input video signal, for example, picture size, aspect ratio, 
field/frame coding type and picture type. The video signal and the skeleton 
information bus are passed to a motion estimator 204. This generates 
candidate motion vectors which are placed on the Information Bus. A 
prediction selector 206 receives both the video signal and the information bus 
and selects between the different candidate motion vectors. It also selects 
which prediction mode (field, frame, forward, backward, bi-directional etc.) is 
to be used for each macroblock. The prediction selector 206 further performs 
inter/intra selection and DCT type selection. 

The information bus at the output of the prediction selector 206 
contains all the decisions necessary for the creation of an MPEG bitstream 
apart from those relating to quantization. These are provided as follows. 

A "dumb" coder 208 operates on the video signal, guided by the coding 
decisions represented in the information bus. A bit rate controller 210 
receives the coded bitstream and controls the quantization in the dumb coder 
to bring the output bit rate to a notional bit rate representing the probable 
output rate of a downstream encoder. The dumb coder then places on the 
information bus the quantizer information employed to generate a bitstream at 
the desired notional bit rate 
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So far, what has been described in Figure 2 is identical to an MPEG 
coder, based on the information bus as shown in the referenced prior 
. publications. In this application, however, the bitstream is not used and only 
the final information bus appears at the output of the coder 208. 
5 This information bus is then processed using techniques described in 

WO-A-9803017. Briefly, the information bus passes to an information bus 
coder 212 which performs variable length coding, packetisation and allocation 
of time stamps. This represents a convenient form of compression using, 
essentially, the MPEG2 syntax. Indeed, the information bus in one form can 
io be viewed as the MPEG2 bitstream minus the DCT coefficients. 

There are various possibilities for the format of an information bus 
signal, according to its timing relationship with the video signal it 
accompanies. Formatting is carried out by the information bus formatter 214. 
Examples of possible formats for the information bus signal are as follows: 
15 (') A fixed-bit-rate signal but containing a variable number of bits 

per picture and transmitted with no regard for synchronisation to the video 
signal. In practice, the signal could have a variable bit-rate but could be made 
to occupy a fixed-bit-rate channel by the use of stuffing bits. 

ii) A fixed or variable-bit-rate signal which is re-ordered (from 

20 bitstream order to display order within the GOP structure) and time-shifted so 
that the information bus for each picture is co-timed with the video signal for 
that picture. 

iii) A mixture of the two, in that the information bus itself is 
asynchronous but a small slot is reserved for some picture-locked data; this 

25 would carry, for example, duplicates of time_code and picture_type. 

iv) A fixed-bit-rate signal which is re-ordered and time-shifted as 
described in the second option above, but additionally arranged so that the 
macro-rate information for each macroblock is co-timed with the video signal 
corresponding to the macroblock. 

30 Tne formatted information bus then passes to a channel adapter 216, 

which adapts the information bus to accompany the video signal (which has 
been delayed in compensating delay 218) in any of the ways described by 
way of example with reference to Figure 1. Thus, in a preferred example, the 
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channel adapter 216 embeds the formatted information bus in the least 
significant bit of the colour-difference part of a 10-bit ITU-R Rec. 656 signal, 
with in the active video region only. , 7 

In a modification "to the arrangement illustrated in Figure 2, two or more 
dumb coders 208 and associated bit rate controllers 210 could work in 
parallel, each at a different bit rate covering the range of likely future 
requirements. The quantizer information generated at each bit rate could be 
recorded in the information bus. 

In a further alternative, the bit rate controller 210 could be removed and 
the dumb coder or coders 208 could work with a fixed quantizer or quantizers. 
The resulting numbers of bits generated for each macroblock could then be 
recorded in the output information bus. 

Figure 3 shows how a pre-processor according to this invention might 
be used in conjunction with a server designed for uncompressed video 
signals. The pre-processor works as described above to add an information 
bus to a digital video signal. The resulting video + information bus signal is 
written onto a server. There are then shown three examples of how the 
signal might be used downstream to produce bitstreams. 

In each example, the signal is read from the server and sent to an 
Information Stream decoder which passes the resulting video and Information 
Bus signals to a dumb coder. 

In the first example, dumb coder 1 simply slaves to the incoming video 
and information bus signals and produces a bitstream at the bit rate (or a 
chosen one of the bit rates) generated by the pre-processor. 

In the second example, dumb coder 2 works at a new bit rate. The 
quantizer information in the information bus is ignored and is replaced by 
quantizer information calculated by the local bit rate controller. 

In the third example, (enhanced) dumb coder 3 makesuse of both the 
local bit-rate controller and the quantizer or bit-count information decoded 
from the information bus to improve the performance of the encoder. 
Effectively, the known benefit of two-pass encoding is obtained, that is to say 
pre-analysis and a second pass through the bit rate control process. 
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Either of the second two configurations could be used as Mrt , 
b-tstream switch or other bitstream processor in which it is neC 
control the bit rate and th« ™ ™ necessary to 

~ " u,. , - and - the occu P anc y°fthe-coder buffer 

Whilst the use of an information bus which is eff^r , 
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CLAIMS 



1. A video signal process comprising the steps of analysing a video signal 
and taking compression coding decisions; forming a representation of the 
coding decisions for passage with the video signal along a video pathway and 
downstream of the video pathway compression encoding the video signal in 
accordance with said coding decisions. 

2. A process according to Claim 1 wherein said representation of the 
coding decision comprises an information bus in which the coding decisions 
are represented in the same format as they are represented in the 
compressed bitstream which is the output of said downstream compression 
coding operation. 

3. A process according to Claim 1 or Claim 2, wherein said analysis 
generates information relating to picture size and type. 

4. A process according to any one of the preceding claims, wherein said 
analysis comprises the generation of candidate motion vectors. 

5. A process according to Claim 4, wherein said analysis comprises the 
selection for each macro block of the picture of a motion vector from said 
candidate motion vectors. 

6. A process according to Claim 5, in which said analysis comprises the 
selection of a macroblock prediction mode. 

7. A process according to any one of the preceding claims wherein said 
analysis includes a bit rate control and the taking of quantizer decisions 
appropriate to the maintenance of the selected bit rate. 
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8. A process according to Claim 5 wherein plural bit rates are selected 
and plural quantizer decisions taken. 



9. Compression pre-processing apparatus, comprising means for 
analysing a video signal and taking compression coding decisions; means for 
processing the coding decisions and means for outputting the processed 
coding decisions for passage with the video signal along a video pathway. 

10. Apparatus according to Claim 9, wherein said means for processing 
the coding decisions provides a representation of the coding decisions in the 
form of an compressed video bit stream lacking transform coefficients. 

1 1 . Apparatus according to Claim 9, wherein said means for outputting the 
processed coding decisions serves to modulate one or more least significant 
bits of the video signal. 
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sheets / fig. 
sheets / fig. 



1/3-3/3 



, as originally filed 

, filed with the demand 

, filed with the letter of 



2. The amendments have resulted in the cancellation of: 

□ the description, pages: 

[x] the claims, Nos. 1 

□ the drawings, sheets / fig. 



3. □ This report has been established as if (some of) the amendments had not been made, since they have been considered to go 
beyond the disclosure as filed (Rule 70.2 (c)). 



4. Additional observations, if necessary: 
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V. Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; citations 
and explanations supporting such statement 



1. Statement 



Novelty Claims 2-8, 10, 11 YES 

Claims 1,9 NO 



Inventive Step Claims 

Claims 1-11 

Industrial Applicability Claims 1-11 

Claims 



YES 
NO 
YES 
NO 



2. Citations and Explanations 

Citations: D1 = WO-A-9535628 
D3 = EP-A-597647 
D4 = WO- A-95 15659 

The subject-matter of claim 1 does not meet the requirements of Art 33(2) PCT, 
since document D1 discloses (see figure 1): a video signal process comprising 
the steps of analysing an input video signal P (by means of pre-processor 10) and 
taking compression coding decisions (concerning for example "recommended 
motion vectors", see page 7, lines 1 , 2); forming a representation of the coding 
decisions (see information bus IB); passing the representation (IB) along a video 
pathway (video pathway between blocks 10 and 12) with the input video signal P; 
and downstream of the video pathway compression encoding the input video 
signal (by means of coders 12 and 22, producing an MPEG-2 compressed video 
signal CP) in accordance with said coding decisions (IB). 

The subject-matter of claim 1 therefore lacks novelty. 

Attention is also drawn to the fact that document D1 also appears to disclose all 
the alleged inventive concepts of the present application, in particular 

A) "... an information bus (which) extends from a decoder or to a coder in the 
chain, the information bus carrying information relating to a coding operation 
for use in a later signal process." (See characterising part of claim 1 of D1, 
see the physical format of the information bus on page 9) 
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B) the optional embedding of the coding information in the video stream (see 
signal CP between blocks 22 and 24 in Figure 1) 

The subject-matter of claim 9 does not meet the requirements of Article 33(2) 
PCT, since document D1 discloses (see Figure 1): a compression pre-processing 
apparatus, comprising means (block 10) for analysing a video signal (P) and 
taking compression coding decisions (recommended motion vectors, for example, 
see page 7, lines 1 , 2); means (the same block 10) for processing and for 
outputting the processed coding decisions (see information bus IB) for passage 
with the video signal (P) along a video pathway (between blocks 10 and 12). 

The subject-matter of claim 9 lacks therefore novelty. 

It is further noted that the subject-matter of claims 1 and 9 also appears to lack 
either novelty or an inventive step having regard to each of the disclosures of 
documents D3 and D4. 

Document D3 discloses (see Figure 1) an encoder (3) which encodes video data 
in accordance with coding decisions (frame structure, predictive mode, motion 
vector, quantising parameter) taken in advance by blocks 2 and 4. 

Document D4 discloses (see Figure 3) an encoder (103) which encodes video 
data in accordance with coding decisions (either vertical frame-based filtering or 
vertical field-based filtering) taken by video data stream analyser 300 (see page 7, 
lines 27-32). 

The subject-matter of dependent claims 2-8, 10, 1 1 appears only to relate to 
details of implementation of the known process and apparatus which are either 
already disclosed by the above cited documents or are considered to be within 
the freedom of the person skilled in the art. The subject-matter of dependent 
claims 2-8, 10 and 11 thus lacks an inventive step (Article 33(3) PCT). 

The presently claimed subject-matter relates to the field of electronics and in 
particular to the design of electronic devices which are then manufactured by the 
industry. The present claims thus possess industrial applicability. 
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Certain defects in the international application 



The following defects in the form or contents of the international application have been noted: 



D 

2) 

3) 
4) 



To meet the requirements of Rule 5.1 (a)(ii) PCT the differences between the prior 
art disclosed by document D1 and the present invention should have been 
discussed in the description. 

To meet the requirements of Rule 6.3(b) PCT the independent claims should have 
been properly cast in the two part form, with those features which in combination 
are part of the prior art being placed in the preamble. 

Reference signs in parentheses should have been inserted in the claims to 
increase their intelligibility, Rule 6.2(b) PCT. 

The consistory clause forming the disclosure of the invention as claimed should 
have been brought into agreement with the claims of the broadest scope, 
Rule5.1(a)(iii) PCT. 
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CLAIMS 



1 . A video signal process comprising the steps of analysing an input video 
signal and taking compression coding decisions; forming a representation of 

5 the coding decisions; passing the representation along a video pathway with 
the input video signal; and downstream of the video pathway compression 
encoding the input video signal in accordance with said coding decisions. 

2. A process according to Claim 1 wherein said/epresentation of the 

io coding decision comprises an information bus in Wnich the coding decisions 
are represented in the same format as they are/epresented in the 
compressed bitstream which is the output of said downstream compression 
coding operation. / 

15 3. A process according to Claim 1yor Claim 2, wherein said analysis 
generates information relating to picture size and type. 

4. A process according to any one of the preceding claims, wherein said 
analysis comprises the generation of candidate motion vectors. 

20 / 

5. A process according to Claim 4, wherein said analysis comprises the 
selection for each macrpblock of the picture of a motion vector from said 
candidate motion vectors. 

25 6. A process Recording to Claim 5, in which said analysis comprises the 
selection of a mpcroblock prediction mode. 

7. A process according to any one of the preceding claims wherein said 
analysis includes a bit rate control and the taking of quantizer decisions 
30 appropriate to the maintenance of the selected bit rate. 
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ACTION 


International application No. 
PCT/GB 99/00228 


International filing date (day/month/year) 

22/01/1999 


(Earliest) Priority Date (day/month/year) 

22/01/1998 


Applicant 

SNELL & WILCOX LIMITED et al . 



This International Search Report has been prepared by this International Searching Authority and is transmitted to the applicant 
according to Article 18. A copy is being transmitted to the International Bureau. 

This International Search Report consists of a total of 3 sheets. 

[X] It is also accompanied by a copy of each prior art document cited in this report. 



Basis of the report 

a. With regard to the language, the international search was carried out on the basis of the international application in the 
language in which it was filed, unless otherwise indicated under this item. 



□ 



the international search was carried out on the basis of a translation of the international application furnished to this 
Authority (Rule 23.1(b)). 

With regard to any nucleotide and/or amino acid sequence disclosed in the international application, the international search 

was carried out on the basis of the sequence listing : 

| | contained in the international application in written form. 

filed together with the international application in computer readable form. 

furnished subsequently to this Authority in written form. 

furnished subsequently to this Authority in computer readble form. 

the statement that the subsequently furnished written sequence listing does not go beyond the disclosure in the 
international application as filed has been furnished. 

the statement that the information recorded in computer readable form is identical to the written sequence listing has been 
furnished 
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□ 
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2. 
3. 



| | Certain claims were found unsearchable (See Box I). 
| | Unity of invention is lacking (see Box II). 



4. With regard to the title, 

[X] the text is approved as submitted by the applicant. 

| | the text has been established by this Authority to read as follows: 



5. With regard to the abstract, 
|X| the text is approved as submitted by the applicant. 

□ the text has been established, according to Rule 38.2(b), by this Authority as it appears in Box III. The applicant may, 
within one month from the date of mailing of this international search report, submit comments to this Authority. 

6. The figure of the drawings to be published with the abstract is Figure No. 



[X"| as suggested by the applicant. Q None of the figures. 

| | because the applicant failed to suggest a figure. 

| | because this figure better characterizes the invention. 
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